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We present inelastic neutron scattering measurements of the antiferromagnetic insulator 
CaMn 2 Sb 2 , which consists of corrugated honeycomb layers of Mn. The dispersion of magnetic 
excitations has been measured along the H and L directions in reciprocal space, with a maximum 
excitation energy of ~ 24 meV. These excitations are well described by spin waves in a Heisen¬ 
berg model, including first and second neighbor exchange interactions, Ji and J 2 , in the Mn plane 
and also an exchange interaction between planes. The determined ratio J 2 /J 1 ~ 1/6 suggests that 
CaMn 2 Sb 2 is the first example of a compound that lies very close to the mean field tricritical point, 
known for the classical Heisenberg model on the honeycomb lattice, where the Neel phase and two 
different spiral phases coexist. The magnitude of the determined exchange interactions reveal a 
mean field ordering temperature ~ 4 times larger than the reported Neel temperature Tn = 85 K, 
suggesting significant frustration arising from proximity to the tricritical point. 

PACS numbers: 78.70.Nx, 75.30.Ds, 75.50.Ee, 75.10.Hk 


Erustration occurs in spin systems when constraints 
prevent the formation of a ground state satisfying all of 
the pairwise interactions [ 1 ]. The defining characteris¬ 
tics of frustration are massive ground-state degeneracy 
and concomitant strong fluctuations among these states. 
Thermal and quantum fluctuations suppress magnetic or¬ 
der and, under certain conditions, can lead to spin liq¬ 
uid regimes extending to low temperature. The honey¬ 
comb lattice is an interesting manifestation of a spin sys¬ 
tem where frustration arises from competing interactions 
rather than geometric constraints, and this frustration is 
further enhanced by strong quantum fluctuations due to 
the low coordination number z= 3 . 

The system of interacting spins on a honeycomb lattice 
has attracted the attention of theorists for decades HE], 
with more recent calculations proposing that a spin liq¬ 
uid state can be stabilized on this lattice [IHZ] • Com¬ 
petition between first, second and third neighbor mag¬ 
netic exchange interactions, Ji, J2, and J3, results in a 
rich magnetic phase diagram laia. Eor classical local¬ 
ized spins described by a Heisenberg Hamiltonian, Neel, 
stripy, zigzag and spiral magnetic orderings are possi¬ 
ble depending on the relative strengths of these inter¬ 
actions. Eurther, three tricritical points, where three of 
these types of long range magnetic order become degen¬ 
erate, are predicted and the strongest frustration would 
be expected near these points [2]. 

The honeycomb lattice compounds MnTiOs and 
BaNi2(P04)2 were discovered early on [ 8 l| 9 ]. Both were 
found to be Neel antiferromagnets with MnTiOs ordering 
at 64 K [10] and BaNi2(P04)2 ordering at 23.5 K [TT] . 
in agreement with the determined exchange interactions 
that place them deep in the Neel phase of the theoret¬ 
ical honeycomb lattice phase diagram mm- More 


recently, there have been several experimental realiza¬ 
tions of frustrated honeycomb lattice systems with an- 
tiferromagnetic interactions based on transition metals, 
e.g. Bi3Mn40i2(N03) [ 13 ], (Na/Li)2lr03 [T 4 HT 6 ] . a- 
RuCls [II] SrL204 (L = Gd, Dy, Ho, Er, Tm, and 
Yb) [H], CusSbOe [H], and GusMsSbOe (M = Ni, 
Co) [20]. While inelastic neutron scattering measure¬ 
ments and complementary electronic structure calcula¬ 
tions have placed bounds on the exchange interactions 
in Bi3Mn40i2(N03) [ 2 Th 23 ] and Na2lr03 [ 24 ] [ 25 ], de¬ 
termination of individual exchange interactions in these 
compounds has not been possible due to the lack of large 
single crystals and/or strong Ir absorption. Uncertainty 
remains over even the relative strength of the exchange 
interactions in these compounds. This has hindered com¬ 
parison with theoretical phase diagrams, which propose 
spin liquid and highly frustrated phases depending on the 
value of the exchange interactions [ 4]-[71 [ 26 ] . 

We present inelastic neutron scattering results that 
characterize the exchange interactions in single crystals 
of the antiferromagnetic insulator GaMn2Sb2, which con¬ 
sists of honeycomb layers of Mn in which every other 
atom is shifted perpendicular to the ab plane mm- 
Neutron powder diffraction measurements reveal Neel- 
type antiferromagnetic order in GaMn2Sb2 below T^v 
= 85 - 88 K, with an ordered moment between 2 . 8 - 3.4 
/i^/Mn [ 29 l| 30 ]. The magnetic moment is substantially 
smaller than the 5 /i^/Yln expected from the high spin 
state produced by Hund’s rules, and this reduced mo¬ 
ment may reflect the interplay of quantum fluctuations 
and hybridization HU Eg. The moments are refined to 
lie in the honeycomb a-b plane, possibly with some de¬ 
gree of out-of-plane canting. Between Tn and 210 K a 
weak ferromagnetic component was detected in magnetic 
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susceptibility measurements [28]. From 340 K - 400 K, 
Curie-Weiss behavior was reported with a low param¬ 
agnetic moment of 1.4 /r^/Mn [28|. The low ordering 
temperature, as well as the unusual character of the in¬ 
termediate temperature phase, suggest that frustration 
characteristic of the honeycomb lattice may be a crucial 
part of the magnetism of CaMn2Sb2, unaddressed until 
now. 

Our single-crystal inelastic neutron scattering mea¬ 
surements reveal spin wave excitations in CaMn2Sb2 at 
T = 5 K<<T7 v. We will show that these excitations 
are well described by a Heisenberg model of spins on a 
corrugated honeycomb lattice, allowing us to character¬ 
ize the antiferromagnetic exchange interactions Ji and 
J2, as well as the exchange interactions between nearest 
neighbors in the c-direction Jc. Using the exchange in¬ 
teractions determined in this way, we situate CaMn2Sb2 
on the theoretical magnetic phase diagram, and find it 
is proximate to a tricritical point, and is consequently 
magnetically frustrated. 

Our inelastic neutron scattering measurements were 
carried out on the SEQUIOA time-of-fiight instrument 
at the Spallation Neutron Source at Oak Ridge National 
Laboratory [33] . An incident energy of 50 meV was used 
yielding energy resolution of 1 meV, with the Fermi chop¬ 
per 2 set to 420 Hz and the TO chopper set to 90 Hz. The 
measurements were performed on four co-aligned single 
crystals of CaMn2Sb2, of total mass 3.2 g mounted on a 
sheet of aluminum in a displex helium closed cycle refrig¬ 
erator. These single crystals were grown from a Sn flux, 
as detailed elsewhere [28] . 

The crystal and magnetic structures of CaMn2Sb2 are 
presented in Figure CaMn2Sb2 forms in the trigo¬ 
nal CaAl2Si2 structure type with lattice parameters a = 
4.52 A and c = 7.46 A [34]. The corrugation between 
nearest-neighbor black and green Mn atoms in the ab 
plane is evident (Figure [^). The first neighbor Mn-Mn 
spacing between respectively buckled Mn atoms is 3.2 A 
and the second neighbor spacing corresponds to the lat¬ 
tice constant a. Most interestingly from a magnetic per¬ 
spective, viewing the crystal structure from above (Fig¬ 
ure]^) reveals a honeycomb lattice of Mn. The magnetic 
moments associated with the Mn atoms form a Neel an¬ 
tiferromagnetic pattern in the ab plane below Tat , and 
the nearest-neighbor exchange along the c direction Jc 
is also antiferromagnetic (Figure [^) [29l[30]. We may 
consider the three first neighbor Mn spins as coupled by 
exchange interaction Ji and six second neighbor spins 
coupled by exchange interaction J2 (Figure [^). These 
exchange interactions are mediated by one superexchange 
path connecting nearest neighbor Mn spins with ZMn- 
Sb-Mn angle of 70° and another connecting the second 
neighbors with ZMn-Sb-Mn = 108°. 

Figure [^presents an overview of our inelastic neutron 
scattering measurements of CaMn2Sb2. The energy de¬ 
pendence of the scattered neutron intensity S(Q,E) along 
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FIG. 1. (Color online) (a) The crystal structure of CaMn 2 Sb 2 , 
which forms in the trigonal CaAl 2 Si 2 structure type (S.G. 
P3ml, no. 164). An outline of the unit cell is shown. The 
corrugation of the honeycomb layer of Mn is emphasized by 
the black and green Mn atoms displaced along c-direction. 
Exchange interaction along the c-direction Jc is indicated, 
(b) A compressed view of the Neel antiferromagnetic corru¬ 
gated honeycomb lattice formed by the Mn moments in the 
ab plane. Exchange interactions between first neighbors Ji, 
second neighbors J 2 and third neighbors J 3 are indicated. 


the H and L directions is presented in Eigure[^-b. Here, 
we define Q = bi h + b2 k + bg 1 = (H,K,L) where 
bi,2,3 are the reciprocal lattice vectors of the trigonal 
lattice m Sharp, dispersive excitations emerge from all 
reciprocal lattice points with integer h and 1 values, as 
expected for spin waves in the Neel phase of a honey¬ 
comb lattice. Two spin wave branches are discernible 
corresponding to an acoustic mode and an optical mode 
emanating from the antiferromagnetic zone center and 
4 meV respectively. The excitations are similar along 
the (HOI) and (-10L) directions, with a maximum spin 
wave energy of ~ 24 meV in both cases. S(Q,E) is ob¬ 
served to decrease slightly as the wavevector increases, 
as expected from the magnetic form factor for Mn, act¬ 
ing in concert with the polarization dependent scattering 
from the ordered magnetic moments [36] [37]. Eigures|^-f 
present two-dimensional cuts along the H and L direc¬ 
tions for increasing energy transfers. Eor data summed 
over energy transfers 5 meV<E<10 meV (Eigurej^), we 
observe the most intense scattering in an oval shape cen¬ 
tered at the Bragg position (h,k,l) = (-1,0,0). These data 
are consistent with the scattering expected from disper¬ 
sive spin wave excitations. Eor larger energy transfers 
(Eigure[^-e) S(Q,E) has only a two-fold rotational sym¬ 
metry centered at the Bragg position, suggesting the spin 
waves disperse differently along the H and L directions. 
Eor 20 meV<E<25 meV (Eigurej^), the spin waves have 
dispersed to the edge of the Brillouin zone, consistent 
with a magnon bandwidth of ~ 25 meV. The energy and 
wavevector dependence of the scattered neutron inten- 
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sity behaves just as expected for three-dimensional spin 
waves. 



FIG. 2. (Color online) Contour plots of inelastic neutron scat¬ 
tering intensity at T = 5 K. Scale bars are shown on the left. 
Scattered neutron intensity as a function of energy E along 
the (a) H direction, (b) L direction. Scattered neutron inten¬ 
sity as a function of H and L for (c) 5 < E < 10 meV, (d) 
10< E < 15 meV, (e) 15 < E < 20 meV, (f) 20 < E < 25 
meV 


In Figure we present fits to the observed scattering 
that allow us to extract the spin wave dispersion along 
the H and L directions, and to characterize the magnetic 
exchange interactions in CaMn2Sb2. The scattered neu¬ 
tron intensity S(Q,E) for different energy transfers along 
the H direction is shown in Figure |^. For summed en¬ 
ergy transfers 6 meV < E < 8 meV, S(Q,E) is well fit¬ 
ted by the sum of two Gaussian functions, shifted from 
the magnetic Bragg peak. At larger energy transfers the 
peak positions of the fits move further from the Bragg 
peak, just as expected for dispersing spin wave excita¬ 
tions. For E > 24 meV we no longer observe scattering 
from the spin waves. Eigurej^ presents S(Q,E) along the 
L direction, where we again observe dispersive spin wave 
excitations. Eits along H and L, centered at the average 
spin momenta ±AQ(E), were performed every 2 meV . 
This fitting yields the spin wave momenta for different 
energy transfers, and the resulting spin wave dispersions, 
E(AH) and E(AL), are presented in Eigures|^,d. 


AH (r.I.u.) AL(r.l.u.) 

- 0.4 - 0.2 0.0 0.2 0.4 - 0.4 - 0.2 0.0 0.2 0.4 



AH (r.I.u.) AL (r.I.u.) 


FIG. 3. (Golor online) (a,b) Scattered neutron intensity 
S(Q,E) along the H and L directions for ranges of energy 
transfers E, as indicated. Scans are displaced for clarity. The 
solid lines are fits to the measured data as described in the 
text. (c,d) Black points represent the spin wave momenta and 
energies along H and L extracted from fits. Solid lines are fits 
to the observed dispersion with that expected from a Heisen¬ 
berg spin model, as described in the text, (inset) S(Q,E) as 
a function of E at the zone center. 


A Heisenberg model is used to fit the measured spin 
wave dispersion. Spin wave theory predicts that the one- 
magnon neutron scattering cross-section contains terms 
of the form [38] 


oc y](nq + l)<5(£;(q)-i;)(5(K-q-T) (1) 

q,'r 

where r are reciprocal lattice vectors for a single sub¬ 
lattice, K is the wavevector transfer, q is the wavevec- 
tor, Hq = (exp(E(gr)/kBT)-l)“^, where k^ is the Boltz¬ 
mann constant. In linear spin wave theory, the Heisen¬ 
berg Hamiltonian for an antiferromagnetic configuration 
of spins on a corrugated honeycomb lattice can be deter¬ 
mined from the following dispersion relation: 

E{Q) = 25v/(J(0) - J'(0) + J'(Q) + hA)^ - IJ(Q)|2 

( 2 ) 

Here, S is the total spin on an atom and h^ is a re¬ 
duced anistropy field. The exchange term J(Q) describes 
interactions betweens spins on opposite sublattices and 
J’(Q) describes interactions between spins on the same 
sublattice. The absolute value | J(Q)| must be taken be¬ 
cause the honeycomb lattice is non-Bravais, like the dia¬ 
mond lattice [39|. We include first neighbor exchange 
interactions Ji for spins that are on opposite sublat¬ 
tices, second neighbor interactions J2 for spins that are 
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on the same sublattice, and exchange interactions be¬ 
tween nearest neighbors in different honeycomb layers Jc 
for spins that are on opposite sublattices. The interac¬ 
tion term J’(Q) = Xln n n. , where the sum 

is over the 6 second neighbor atoms. The term J(Q) = 

The resulting expression for the spin wave dispersion 
for a Ji-J2-Jc Heisenberg model were fit simultaneously 
to the measured dispersions along the H and L directions. 
Fits were performed for a gapless acoustic mode (hy^ = 0) 
and a gapped optical mode and are shown respectively 
as black and red solid lines in Figure -d. Excellent 
agreement is found between the Heisenberg model and 
the observed excitations. We find that SJi = 7.9 ± 0.6 
meV and SJ2 = 1.3 ± 0.2 meV are both positive with 
J2/J1 = 0.165, signalling that the in-plane interactions 
are antiferromagnetic. The value of the ratio J2/J1 = 
0.165 remains robust independent of the details of the mi¬ 
croscopic model, that is whether or not the corrugation 
of the honeycomb planes or multiple anisotropy terms 
are included. The exchange interaction betwen nearest 
neighbors in different honeycomb layers SJc = 0.51 ± 0.05 
meV. The experimentally determined values of the ex¬ 
change interactions are in good agreement with values 
obtained from density functional theory (DFT) calcula¬ 
tions [26]. The values found in these calculations are 
SJi = 13.5 meV, SJ2 = 3.25 meV and SJc = 0.45 meV. 
DFT somewhat overestimates the exchange interactions 
as the Hubbard U was not included in the calculations. 
Introducing a third neighbor in plane exchange interac¬ 
tion J3 or second neighbor out of plane exchange does not 
appreciably improve the accuracy of the model presented 
here, and indeed these terms were found to be small from 
DFT calculations [26] . Therefore we do not include these 
terms in our analysis and take J3 = 0. The presence of 
a spin gap and gapped mode is confirmed in the inset to 
Figure [^ that presents scattered neutron intensity at the 
zone center as a function of energy. The anisotropy field 
h^ opens a spin gap of 4 meV at the zone center and the 
effect of the competition between this anistropy and the 
exchange interactions on the phase diagram of the hon¬ 
eycomb lattice will be of interest for future theoretical 
calculations. 

In Figure]^ we use the ratio of the experimentally de¬ 
termined exchange interactions to situate CaMn2Sb2 on 
the phase diagram of the classical J1-J2-J3 Heisenberg 
model [2] for a honeycomb lattice of spins, which is con¬ 
trolled by the ratios J2/J1 and J3/J1. Depending on 
the relative strengths of these interactions different types 
of antiferromagnetic ordering are expected, as indicated. 
Using the values of the exchange interactions determined 
from our inelastic neutron scattering measurements, we 
find that CaMn2Sb2 lies in the Neel ordered region of the 
phase diagram, in agreement with the magnetic struc¬ 
ture determined from powder neutron diffraction mea¬ 
surements [221 EOl- Further, CaMn2Sb2 is found to be 


very close to the tricritical point where Neel order and 
two spiral antiferromagnetic configurations are predicted 
to co-exist. This large degeneracy of possible ground 
states, as well as presumed strong fluctuations among 
these states, is likely responsible for the relatively low 
ordering temperature of CaMn2Sb2 , Tat = 85 K [281132] . 
which is much reduced from the mean field ordering tem¬ 
perature Tmft = (S+l)(3SJi+6SJ2+2SJc)/3kB = 310 
K for S=3/2 or 370K for S= 2. The close proximity of 
CaMn2Sb2 to the tricritical point reported here confirms 
a recent prediction by Mazin m, who speculates that 
the weak ferromagnetic component found in the interme¬ 
diate temperature range could result from this proximity. 



FIG. 4. (Color online) Phase diagram of the Heisenberg model 
for a honeycomb lattice with first, second and third neighbor 
exchange interactions Ji, J 2 , and J 3 respectively [ 2 ]. Solid 
lines are phase boundaries for the different antiferromagnetic 
configurations indicated. The blue, purple, green and red 
symbols represent MnTiOa, BaNi 2 (P 04 ) 2 , Bi 3 Mn 40 i 2 and 
Na 2 lr 03 respectively. Filled black square is CaMn 2 Sb 2 

Until now, there has been a dearth of antiferromag¬ 
netic honeycomb lattice compounds whose exchange in¬ 
teractions have been determined experimentally, so as 
to facilitate comparison with the phase diagram in Fig¬ 
ure The exchange interactions determined from 

a single crystal inelastic neutron scattering study of 
MnTi03 and BaNi2(P04)2 place them deep in the Neel 
phase nnna, in agreement with the determined mag¬ 
netic structure mm- Bounds on the exchange inter¬ 
actions of the effective spin 1/2 honeycomb lattice com¬ 
pound Na2lr03 place it solidly in the zigzag antiferro¬ 
magnetic phase. While this is in agreement with the 
experimentally determined magnetic structure, a Kitaev 
exchange term is important to characterize the strong 
magnetic frustration in this compound, and the strong 
spin-orbit coupling may displace this compound from the 
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indicated position [24l [25] . Inelastic neutron scattering 
measurements have also been reported on the honeycomb 
lattice compound Bi 3 Mn 40 i 2 and, using the resulting 
bounds on exchange interactions, this compound is also 
situated in the Neel antiferromagnetic phase of Figure]^ 
However, long range magnetic order in Bi 3 Mn 40 i 2 has 
not been observed down to 0.4 K, indicating interlayer ex¬ 
change interactions are likely necessary to understand its 
magnetic properties [21]. Thus, our experiments are the 
first to show that CaMn 2 Sb 2 is an antiferromagnetic hon¬ 
eycomb lattice compound situated in close proximity to 
a multicritical point on the phase diagram of the Heisen¬ 
berg model for a honeycomb lattice. This proximity en¬ 
hances the magnetic frustration and further reduces the 
ordering temperature in CaMn 2 Sb 2 from the expected 
mean field ordering temperature. It would be interesting 
to study a structurally similar compound with stronger 
quantum fluctuations, e.g. by replacing the large Mn mo¬ 
ments with lower spin moments, to determine if the long 
range magnetic order could be completely suppressed, 
leading to a spin liquid state. 
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